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Foreword 



As with all instructional material, the selection of appropriate educational computer software is one of" 
the most impprtant responsibilities of teachers and administrators. In these early stages of the develop- 
ment of educational applications of the microcomputer and other interactive learning technologies, it is 
important to establish a strong foundation for our uses of these powerful new .tools. Unfortunately, it has 
become commonplace to hear criticism of much of the available microcomputer educational software. 
Unless high quality materials are used appropriately, the power of the technology will be wasted. 

Recognizing the critical^le of software in computer-based teaching and learning, the Center for Learning 
Technologies of the NewJYork State Education Department and the Northeast Re'gional Exchange are 
pleased to provide thisj^source serieis for teachers and administrators. It provides information on re- 
sources and tools for locating software and assessing its appropriateness for various instructional applica- 
tions. The purpose of the series is not to identify "good" software for educators, but to provide a means 
through which teachers can make decisions about appropriateness and quality within the context of their 
curriculum and instructional needs. , ^ 

This Guide to Software Selection Resources has been designed as a resource series to aid the decision 
makng process in schools. The series includes both generic and content area resources. Part III is the first 
of the content-specific materials; it focuses on reading and communication skills. Continued collabora- 
tion between the Center for Learning Technologies and the Northeast Regional Exchange w ill yield addi- 
tions to this Guide that focus on mathematics, science, and other curriculum priorities, 

J. Lynn Griesemer 
Executive DireCftor 
Northeast Regional Exchange, Inc. 
Chelmsford, Massachusetts 



Gregory Benson 
Director 

Center for Learning Technologies 
New York State Education Department 



Overview 



The purpose of this Guide l cHwarc Selection Resources is to provide teachers uikI administrators with 
a reference tool for identifyi:/|, evaluating and selecting software for use in computer-based teaching and 
learning. The Guide is organized as a sftries of modules that deal with different aspects of the process. 

Part 1 provides an overview of softw are selection and general educational technology resources in New 
York State. This section serves as a preamble to the remaining sections of the Guide, which deal with 
software selection resources in specific content aiv'^as. Special emphasis is placed on the organizational and 
material resources that are available throughout New Vork State to assist educators in implementing 
meaningful applications of computer techfiology, particularly software. 

Part 11 is ,1 general purpose int!;oduction to evaluating software. Prepared by the Northeast Regional Ex- 
change, inc. r nd the Regional E tchange tff the Southwest Educational Development Laboratory, Evalua- 
tion of EducrUional Software: A Guide to Guides serves as a introduction to criteria, procedures and 
sources of itware evaluation information. 

-Part III di ii with software selection information and procedures relating to reading and communication 
skills. Subsequent updates of the Guide will deal A'ith ^"^Iditional subject areas, as well as new general 
purpose resources; A section on matheJmatics and science software is presently under development and 
will be available as Section IV of this Guide in late winter, 1984. , 

A number of assumptions explain the a;: broach we take in the Guide: 

• Software evaluation and selection is t)r*]y one component of a comprehensive computer program devel- 
opment and implementation process, I'h/s process requires the identification and use of a wide range of 
information and assistance resource* available throughout New York State. 

• The selection and evaluation of software is primarily an educational task and only secondly a technical ' 
one. However powerful and sophisticated the microcomputer may be, the pedagogical quality of the 
software is what determines its value in -^ipporting teaching and learning. Thus, while evaluation of 
software may be a relatively new activity, lUe evaluation of traditional instructional materials has been 
taking place for many years. Such evahiation forms the foundation for selecting software. 

• Evaluating instructiciial material oquires an understanding of the teaching and learning context in 
which the materials wiUbe used. What is "gc vd ' instructional material in one setting may be ilriaccepfa- 
ble in another. For this reason^ we have aveic-.ed evaluating or recommending specific software. This is 
not to say that software evaluation is solely a matter of individual judgment; there are accepted stand- 
ards and procedures that can be applied. This Guide deals with such standards, and explains how they 
can be used by teachers and administrators. 
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iNiRor>iJcnoN 



This purl of the Ciiihle is devoted to a review of re- 
sources lor evahuitiiig, selecting, and using sol't- 
ware In teaching reading and conununication skills. 

Perhaps it is because the field is so new, or because 
most teachers of English, reading and writing view 
the microcomputer as unrelated to their teaching, 
but for whatever reason, the amount of informa- 



tion dealing exclusive 
and selection in these s 
most cases, the reader 



ly with software evaluation 
ubject areas is quite small. In 
will do well to use the general 
materials and procedures described in Part I of this 
Guide. There are some other useful resources, how- 
ever, and their numb(^r and variety are likely to in- 
crease rapidly as writers and publishers begin to 
focus on software selection and application from 
specific subject mattet perspectives. 

We assume the reader is familiar with general pur- 
pose software evaluation methods and resources 



such as those described in Part II, ICvuliuitlou of 
Kduentloiiul Softwure: A (lUUIc to (juldes and Part 
1 KduciUloiiul Icchuology Resources hi New York 
Slate. In addition to the general questions ad- 
dressed in those sections, this part responds to the 
following questions asked by English, reading and 
writing teachers who are beginning to use micro- 
computers. 

• Where can I find software for leaching reading 
and communication skills? 

• Where can I find out what descriptive and evalu- 
ative information is available on software used in 
teaching reading and communication skills? 

• What subject-matter standards can 1 use to as- 
sess the quality of the spftware available? 

• Where can I find information to help me use 
software in my teaching? ^ 
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XI 



SOUK€l<:S Of 

EOlJCATlONAI. 

SOIIWARK 



Many Meneial purpose cdncj(lioiial soUwarc evalua- 
tion pnblicalioiis inehidc sections devoted to soft- 
ware lor leacl\ing reading and eonimnnicatiou 
skills. Following arc some specific resources that 
should be rijviewcll: 

CommerciarPublislicrs 

The Nalionc\l Council of Tbachers of English has 
identifi'jd the following publisher?* having soft- 
ware in the English Language Arts: 

Milton Bradley 4'ompany . 

Education Division 

443 Shaker Road \ 

East Lougmeadbw, MA 01028 

Minnesota Educational Computing Consor- 
tium \^ > 
\ 3490 Lexington ^venue North 
St. Paul, MN 55112 

Scholastic Microcomputer Instructional Ma- 
terials 

904 Sylvan Avenue 
..Englewood Cliffs. NJ 07632 

Selected Microcomputer Software 

QppoiTujixties JbrJ earnm _ 

8950 Lurline Avenue ^ 
Dept.26CD 
Chatsworth.CA 91311 

Vanloves Apple II/III Software directory 
Vital Information, Inc. \ 
350 Union Station r 
Kansas City, MO 64106 \ 



MiJiken Puhlishing Company 
1 100 Uesearch Boulevard 
St. Louis, MO 63 1 32* 

Science Research Associates 
High School Division 
155 N. Wacker Drive 
Chicago, 1L60606 

liLS. Inc. 

Random House School Division 
' 400 Hahn Road 
I Westminister, MD2I157 

Courseware Associates, Inc. 
8710 Park Lane^ , 
Suite C . " 
I Dallas. TX 75231 

^ The Micro Center «* 
Dept. S-4 
P.O. Box 6 

Pleasantville, NY 10570 

_ ] #' 

In addition to instructional software, teachers of 
' communicatior\j skills will be interested in identify- 
— ing general purposeword proeess!n&software.-T4iis- 
category includes not only text editors, but spelling 
and grammar checkers. Becaiise much of this soft- 
ware is not used ejcclusively or even primarily in ed- 
ucation, other sources are needed to identify what 
is available. Nearly every computer journal has car- 
Hed an article on word processing software. The 
following sources are samples^of those ajticles. 



l*)H<, pp. liU llO.Mul 171. 

'1n Sinui'li o| it WduI riOirv>r.i," hy l'ini*M I'. 
MiU) ill r/t«<///vi» ( oniinitin^, hnu', l*JHK Muiii 

i|t)/iMl soi l Willi* piH:kitH^"'- 

- "liUnVViMlirs (iiiiilc (ii NN'iinl rimvisinM Tin 
nranis," hv li)»u Shoa itiul Kalhv Thin in /^(A*- 
MiMV^/, \'M\\m\ IV, pp. a; U. hulihlos 
rr)iupi\iis(Mi rhail itiul kIushuiv nl i^Mins ivMiOil 
h) word prtUivssinH sDliwaif, 

Woid puuwssitij^ soi'iwinf and iis aliicalinual ap- 
plli'atious will 1)0 tlisciissfd in lollowinj< paju's. The 
hihiiimiupl^y «,i^nR' icIViuikts ivlaliiu^ lo iLsiiui! 
ctuuMUMcial word processinn sol'iwan* In liu* class- 
rocun. 

Anoihcr aii'a whcMC comnuMcial pnhlislu;r>s have 
prculnccd soriwareorinitMrst io loaohtMS oT rcatling 



\ 



'"To, Succeed on the SAT." Electronic Learning. 
April, 1983, pp. 52-55. 



iiiul rouiiiuinii'ii(ioi) skills is pitpaiiiiiv^i i^m \\\^' 
Si'lu)litslii' ApliiiitiL* k'Niv IhL'i lian ouilu' IdIIou 
iim ilrsi'iilu's U'u pav KafH's t inu'inh on \\w 
iiiarM?!.' (N»>it^ SAI sonwiav is disi iis^n d lait'i i 

INilnlic Doauiiii 

All ol (he piihlir iloruain sodwan* \ \u\\ in I'aii II. 
Mvalitalioii i\i VA\m\[\m\\\ Sor(wMr<*; A ^MiUIr <o 
(JMidcN, (put^tvs H.VHo) hiivf oiTiMinus lor o^^tdinM 
anil ronnnnnioaiioh skills, c ttfoM' orMani^a 
lions (lihMllv I'or s|UTijii' ialoMniUion Ail addi 
lioMid pnhlir domain sonrcf i^: 

* Tlu' lulnralitnial t'otnpnliiiM NtMwork, MoHo 
lloilVMK'a, KiviMsUlc, V\ Ww Nriwork 

idl'ors lixT stiliwaif pro^ntni^i I<m l'a»glish itNa'h 
t;rs in aroiis snclras vticahiiiaiy IniiKlinM and ic 
view, ptK'try, spelllnH, vowi^ls, aial parts ol' 
spoirh. Programs r.Un on Apple II i and Ih*. 
SuMul sciratKlrcsscd, .siampcd envelnpo Kcilh 
1.. Drichcrgal ilic Network iuKlrcss, 



\ 
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Ten SAT Preparation Programs 




Bear Incorporated 
Hofstra University 
Reading; Center 
Att: Mrs. \. M. 

Patttrson 
Hempstead, 
NY 11550 
(51Bj 746-0972 


Verl);il JyVf. 
Vi\n 1: $:"):"). 00 
Van 2: $:">:'). ()0 

SIOO.IMJ 


PET (1()K) 


Stresses 
laiv^UiiKc 
skills, Correc t 
answers pro- 
vided with 
explanations. 


No 


!};'> work- 
sheets and 
teaclier's 
manual 


I'Vee 
backup 
one week 


No 


Ves 


15 minutes 
per test 'SAT 
scoring 
formula 


Borg-Wamer 
Kducattonaf 
Systems 
«(K) West 
l!niversity Drive 
Arlington Heights. 
lI.eOiXM 
1800)323-7577 


CollfKf ('in- 
tr.im f Kxiiin 

frcpHliUKIM 

( Vcrhiil ;ind 
M.illi) I'iirl 1: 
$r>7;i($7n first 
year rental): 
i'art .$H7r> 
(SIO.S first 
year rental) 


Apple II 


Three modes: 
timed lest. 
Iess()ii. and 
intorniation, 
Kxplanatmn^ 
in li'ss(»n and 
inf{)nnaiion 
modes. 


Ves H.') 
sindenls 


Teat*her'^ 
f^niide with 
relrrtiucs 


Free 
backup 
1(1 (lays 


( )n a se'eclive 
i)aMs 


Ves Tf- 
ducv'd rat<* 


'JtH seconds 
[)er qnesrion. 
Teacher may 
adjust lime 
S.-V: s^orin^ 
lonnula 


Edu-Ware 
Services Inc. 
28035 Dorothy Dr. 
Agoura Hills, 
CA 91301 
(213)706-0661 


SAT Word 
Attack Skills 


Apple II 
{48K) 


V(}i abulary 
builder: ex- 
plains wron^ 
answ-eri^ with 
option to ex- 
plain correct 
answer.s. 


No 


Manual 
with brief 
bibliu>{raphy 


Mackup- 
available 
une Week 


No 
• 


Ves mail- 
ing cost 


Adjustable 
tinu'd tests 
Scoring bas(?d 
o[\ jKTcenl 
com:cJ 


Coronado 

Publishers, Inc. 
1250 6th Avenue 
Skn Diego, 
CA 92101 
(800) 782-9016 


Ttie.Commuer 
SAT Test 
Preparalioti 
Kit (Verbal and 
Math)/.m) 
for 16 disk}? 
(four-disk sets) 
and materials 
for 'JO students 


Apple (48K) 
(TK3-80 
available in 
April; IBM 
and Atari in 
June) 

• 


Four pro- 
grams: diag- 
nostic/ 
presinptivf , 
ver-hal and 
math drills, 
and electronic 
vocabulary 
flash cards. 
Explanation 
provided for 
eachquestion. 


Ves, 20 
studeiils 


^0 "How to 
Prepiire tor 
■ the SAT's" 
, books, stu- 
dent K'udes 
with work* 
sheels. 
educator's 
manual, 
user's 
mamiiil ^ 




Ves ^ 


"Ves 


Yes'SATfor- 
Tnul:i, raw 
-seore, and 
percentage 


Krell Software 
Corp. 

1320 Stony 
Brook Rd. 
Stony Brook, 
NY 11 790 
(516) 751-5)39 


SAT Kxamina- 
tion and Prep 
Series (Verba) 
and Math)/ 
$i^^>9.9.5i)er 
paeka^e 


Apple II, TI, 
Conimodor'e 
64, TRS-80, 
IBM. Atari 


Program ad- 
justs itself so 
>iUudents see 
more of the 
types of ques- 
tions they 
consistently 
(<et wroiif^. 
SolulirMis 
given. 




Ntme 


Backup ' 
available 
()ne Week 


No 


Ves pay 
difference 
between 
new and 
old disks 


No timing 
SAT scoring 
fomiula 


MicroLab Inc. 
2310Skokie 
Valley Rd. 
Highland Park. 
IL 60035 . 
(312)433-7550 


KnKlish SATT 
$:UJ.fH) 


Apple II 
(48K). 


(jives expla- 
nations for 
wronjj an- 
swer^. Has 
test mode and 
tutorial mode. 


No 


None 
> 


I backup 
i¥r>/()fi(? 
W(;ek 


Only through 

(k-'alers 


Nil 


No liming/ 

Percent 

incorrect 


Microcomputer 

Workshops 

103 Puritan Drive 

Port Chester. 

NY 10573 

(914)937-5440 


English 
Achievement 
I-V; Apple II 
disk: $39.95: 
PET cassette: 
$20: PET 
disk: $24.95; 
Total of five 
disks or 
cassettes per 
package 


Apple n 
(48K) 
PET (32K) 
PET cas- 
sette (16K) 


Gives com- 
plete explana- 
tions of 
answers ai all 
times. 


No 


Nf)ne 


B;ukup 
.^lO'one 
Week 


!U)d;iy preview 
{y>licy 


Ves 


No liming,' 
Same as 
achieVfineiU 
test sconng 
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J'rojjram Oe.sifjn 




Atari lix^- 


Tiit()ri.il pro- 


No 


Copy of 


I'ree 


No 


No 


Includes dis- 




Inc. 


ihf SAM 


SL'ttf (KiK) 


gram provides 




b{K)klet 


backup/ 






cussion on 




95 East Putnam 


(Verbal and 


Atari drsk 


explanation 




"Makin^i the 


one week 






time strate- 




Avenue 


Math)/ 




for incorrect 




Orade" ^ 








fjies/Nuniber 




Greenwich, 


i-a.ssc*tle: $1:^5 


Apple 11 


answers. 












lorreet afid ' 




'-.CT0H830 
(2nn7^> 1-8799 
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SOURCES OF 
SOFTWARE SELECTION 
INFORMATION 



Thiee categories of information resources are used: 
journals, newsletters and special publications; in-, 
formation clearinghouses; and experienced educa- 
tors.' 

Journals, Newsletters and 
Special Publications 

Because the field is so new, there isonly one journal 
devoted exclusively or primarily to the use of com- 
puters in reading and language arts. 

Computers^ ~ Reading and Language -Arts ; 
Gerald H. Block, Editor-in-Chief, P.O. Box 
13039, Oakland, CA 94661 . 

This journal publishes detailed articles on practical 
applications of conr.puters in teaching reading and 
the language arts; research studies; reviews of soft- 
ware, hardware and books; announcements of 
forthcoming curriculum materials; a calendar of 
events; reader Purveys; and letters to the editon 
(Note: Information taken from a pre-publication 
announcement.) 

Articles on software reviews and applications are 
beginning to appear in the following subject-matter 
journals: 

English Journal. Published by the National 
Council of Teachers of English. 1111 Kenyon 
Road, Urbana, IL 61801 

Language Arts. Publisheid by the National 
Council of Teachers of Engl|sh. Vl 1 1 Kenyon 
Road, Urbana, IL 61801 



The Reading Teacher. Published by thelrher- 
national Reading Association. 800 Barksdale 
Road, PO. Box 813^, Newark, DE 1971 1 

The National Council of Teachers of English^and 
the ERIC Clearinghouse on Reading and Com- 
munications Skills have published: 

Computers in the English Classroom: .A 
Primer for Teachers. It is available from 
NCTE (stock no. 08180). 

TherearFnyspeciaTpi^^ 
to describing and evaluating software in reading 
and communication skills. The publications cited 
in Part II contain numerous references in these sub- 
ject areas, and we include, onHhe following pages, 
some sample citatioi^s from Schobl Microware Re- 
views, EPIE, Courseware Report Card, and the Di- 
gest of Software Reviews. 

Information Clearinghouses 

The professional organizations in these subject 
areas do not maintain clearinghouses dealing with 
software. Tlie ERIC Clearinghouse on Reading 
^d Communication Skills (RCS), working in "^ol- 
laljgr^tion with the National Council of Teachers 
of English G^CTE) and the International Reading 
Association (IRA), has produced several informa- 
tion products dealing with computers and instruc- 
tion in English, reading and writing. These 
products typically take the form of bibliographies. 
Sample titles^re: 



Computers and Reading Instruction 
Computers in Ettjdish 
Word Processingand Writing 
Computers and Composing » 
CAI in the English Classroom 

While these biblioferaphies do not deal exclusively 
or primarily with software descriptions and evalua- 
tions, some descriptions \pf software use are in- 
cluded. ERIC/RCS is located at NCTE's officesr 
The address is: 



National Council of Teachers of English . 
1111 Kenyon Road 
Urbana,IL 61801 
217-328-3870 

The National Council of Teachers of English has 
formed a Committee on Instructional Technology 
which has the following charter: 

^j?stablish guidelines for the development of 
computer materials ^d other complex soft- 
ware. in the language arts; to develop guide- 
lines for classroom use of new instructional 
technologies; to define those content areas and 
process objectives within the English curricu- 
lum which best \hnd themselves to delivery 
through new instructional technologies; to 
suggest new uses of technology and needed ar- 
eas of research in the use of -interactive media 
(e.g., the composing process using word proc- 
essors; use of computers in teacher training 
and in adaptive testing); to encourage the use, 
of video-disc technology as a potential me- 
dium for instruction, information storage, 

J a nd q uality entertain ment; to consider wa r^^ of_ 

gathering and disseminating teacher - • 
and/or teacher-tested games, lessons and i^- . . 
. on how to use computers; to make English 
teachers at all levels aware of howNiew technol- 
ogies can be used to develop, skill in language 

One of the Gommittee's first products is a set of 
guidelines for evaluating software in language arts. 
These guidelines are included in the following sec- 
tion. The Committee also will address the issue of 
computer literacy as it relates to computer-based 
language arts instruction and word processing. 
NCTE will make available a list of sources of soft- 
ware that can be used in language arts. A publica- 
tion resulting from the Committee's work is 
Computers in the^^nglish Classroom: A Primer for 
Teachers (NCTE, Stock No. 08180). 

In New York State, the following organizations 
, provide information on software used in teaching 
reading and communication skills. 



New York State Reading Association 
300 Hay ward Avenue 
Mt. Vernon, New York 10:52 * 
912-942-2700, - - 

New York State English Council 
P.O. Box 2397 : : 

Liverpool, New York 13089 
315-652-1 n8 

The Demonstration and Technical Assistance Cen- 
ters listed in Part I provide descriptive and evalua\ 
tive information on software, and provide preview 
facilities as well. 

Human Resources 

The bibliography lists several experts contributing 
to the appropriate use of software in trjaching read- 
ing and communication skills. For information 
about the work of the NCTE' Committee on In- 
structional Technology, contact: 

Dr. Robert Caldwell 

School of Applied Health Science Center ^ 
" University of Texas ' . 
Dallas, TX 75235 

Others whose work was reviewed in the preparation 
of this guide are: 

John Henry Martin, Jr. 
Stuart, FL 
D. Midian Kurland 
Bank Street College of Education 
Center for.Children and Technology 
610 West 112th StVeet 
New York, NY 10025 
And ee Rubin . 
Bolt, Beranek andJVIewman, Inc. '~_ ~ 
50 Moulton Street ^ 
Cambridge, MA 02238 

Henry Olds, Jr. 
Intentiotial Educations, Inc. . ; 

341 Mt. Auburn Street 
Watertown, MA 02172 

In New York, the Statewide Instructional Comput- 
ing Network (SICN) is preparing a list of resource 
persons who are able and available to assist teach- 
ers and administrators in a wide range of computl^r 
applications, including software evaluation, selec- 
tion, and use. You can obtain this list by contact- 
ing: j 

Dr. Alan Osterhoudt | ^ 

Assistant Superintendent / 
Herkimer BOCES 
. Gt^s Boulevard 
^Hg'rkimer, NY 13350 
il$-867-2007 
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Automated Information 
Clearinghouses^ 

' This category includes computer-based informa- 
tion databases that give exclusive or considerable 
attention to software. All of these databases may be 
searched (are searchable) over the telephone lines 
using a microcomputer and a modem. Searching 
these databases requires some special skills, but the 
effort is rewarded with access to thousands of refer- 
ences and actual documents and journal articles on 
software and its applications. Using ' special 
"searching." techniques, those articles or docu- 
ments dealing with a specific topic or software ma- 
terial can be located intninutes and reviewed on the 
^ ^ computer monitor. Print documentation is usually 
available through the mail within a short turn- 
around time. J 

Resources in Coiflputer Education (RICE). 
Developed by the MicroSIFT Project at the 
Nortfiv^est Regional Educational Laboratory, 
3(X) S.W. Sixth Avenue, Portland, OR 97204. 
Available online from Bibliographic Rctneval 
Services, |2(X) Roui:e7, Latham, NY 12110. 

RICE is a file of information on the educational 
applications of microcomputers. It has five sub- 
files, not all of which 7ixt available presently: 

• Producers, which include all commercial aod 
noncommercial producers of computer-based in- 
structional and administrative software; 

• So ft ware- Packages, which contains descriptive 
and evaluative information about known prpd- 
ucfs from producers; 

• Computer Literacy, which contains objectives 
and test items; 

• Inventory, which contains numbers of student 
stations and other data on installations of hard- 
ware in schools; 

• Project Register,' which contains descriptions of 
research and development projects in K-12 com- 
puter applications. ^ 

Although all of the files are potentially useful to 
microcomputer users, the one containing informa- 
tion on software packages is particularly suited to 
software evaluation. This sub-file may be searched 
by using the key words that define the kind of infor- 



mation needed. For example, you can identify all of 
the software that is available for teaching eco- 
nomics in the junior high school, and th^* will run 
on a particular microcomputer. 

A notable feature of RICE is that it contains evalu- 
ation ir^formation on much of the software in the 
file. There is a special section (called a field) of each 
description that is devoted to evaluation informa- 
tion. This evaluation is based on reviews ol* the soft- 
ware by educators throughout the couiitry that 
collaborate with MicroSIFT in evaluating software. 
RICE descriptions also contain references to re- 
views in other publications. 

School Practices Information File (SPIF). De- 
veloped and provided by Bibliographic Re- 
trieval Services, 1200 Route 7, Latham, NY 
12110. o -V| 

SPIF is a file of educational programs, practices 
and materials. A major portion of the file is de- 
voted to descriptions of software, searchable in 
much the same manner as the RICE file. SPIF soft- 
ware descriptions typically do not contain evalua- 
tion information. 5 

Educational Rcsouirces Information Center 
(ERIC). Produced by the National Institute of 
Education through contracts with several or- 
ganizations; availgJble through most of the 
v^'n4ersof online databases. 

ERIC is the major file of educational information 
in the country. It has descriptions of all forms of- 
information — fe^earch reports, curriculum 
guides, speeches, programs, journal articles. While 
ERIC contains few if any software descriptions, it 
does contain scores of records describing educa- 
tional applications of microcomputers and soft- 
ware. 

Information from all three of these files is available 
from the Educational Programs and Studies Infor- 
mation Services (EPSIS) in the New York State Ed- 
ucation Department. EPSIS may be contacted at: 

New York State Education Department 
Room 330 EB 
Albany, NY 12234 
518-474-3639 
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METHODS OF 
DESCRIBING AND 
EVALUATING 
EDUCATIONAL 
SOFTWARE 



The checklists in Part II are useful for describing 
and evaluating all software. This section deals with 
information, specific to reading and communica- 
tion skills that should be obtained as a supplement 
to that in the general checklists. In these subject 
areas, literature dealing with assessing software hks 
only recently begun to appear in the popular con- 
tent and professional journals, and is still relativeJy 
scarce. The NCTE Committee on Instructional 
Technology has prepared an* evaluation checklist 
for use with language arts software and general 
purpose software. This checklist, reproduced on 
the following pages, contains descriptive, applica^ 
tion and evaluative criteria, and is similar to the in- 
stilments in Part II. 

Essentia! Descriptive and 
A|)plicatiori Information 

The instruments contained in Part II and that used 
. by the Center for Learning Technologies (see Part 
1) will serve most requirements in, deciding 
whether undertaking an evaluation o^a particular 
software program is worthwhile, Mosyof the ques- 
tions in those checklists can be applied to general- 
' purpose software (such as t^ose for handling text, 
data and graphics),, that can be transformed into 
educational software by developing the appropriate 
support materials for teachers and students. The 
most popular software in this category is word 
processing programs, Although software that al- 
lows students to build information files of re- 
sources is coming into use in secondary schools. 



Evaluation Criteria Related to 
Reading and Communication Skills 

Although the NCTE instrument isbsimilar to the 
checklists in Part II, it incorporates a few general 
items' relating to the language arts curriculum (e.g., 
numbers HI-13-15). In addition, it provides supple- 
mentary questions f6r word processing and other 
general-purpose software. In general, however, 
checklists will be of limited utility in assessing the 
content of the software, because they do not ade- 
quately take into account the subject matter of the 
program. 

Deciding whether a specific software package is ap- 
propriate for specific classroom applications re- 
quires an understanding of curriculum standards 
and guidelines. In addition to the fe;erieral evalua- 
tion criteria listed in Part II and in the NCTE in- 
strunient, you will need to assess the software 
against the standards established at the district and 
state levels. The following criteria are suggested by 
the N 2w York State Education Depatment: 

Does Software used for writing instruction: 

reflect an uifderstandmg of writmg as a pro- 
cess of communication, as well as a way to dis- 
cover and activate ideas? 

help students generate ideas for v^/^Wng, select 
and arrange those ideas, fin3 appropriate 
modes for expressin/^ them, o- ■ y^ii; and re- 



vise the written product? 
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NCTE Guidelines for Software Review and Evaluation 



PROGRAM: 
PRODUCER: 



REQUIRED EQUIPMENT 



GRADE LEVEL: 



COST. 



OVERALL PROGRAM OBJEC HVES: 



SINGLE LESSON OBJECTIVES (if you are reviewing one lesson only): 



Answer yes orno for the foVomng criteriq; in Sections I tlirough V. ' 
I. MANAGEMENT FEATURES . 

y ., 

1. Program f)rovides teacher with a management system. (If ho, go to Section lU) 

\ ■ ■ 

2. Program ha? record-keeping system that is useful and efficient. 

- 3. Records are easily retrievable. 

^ 4. Teacher can assign performance levels and otherwise modify or add to records. 



II. CONTENT 

- 1. Content is accurate. 

— - ^ 2. Content is appropriate to grade level for \yhich it is intended^ 

^ 3. Conrent can be modified by student or teacher. 

4. Possible content modifications are appropriate to the subject matter. 

— L : 5. Program contributes to the Language Arts curriculum. 



6. Program achieves its purpose. 



7. Program is motivating lo\s(udents. 
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111. INSTRUCTION/XL STRATEGY 



(Note: U the software you are reviewing is other than tutorial/drill and practice, go to the Guidelines 
Addendum to complete this section. Then continue with Section IV.) 

1. Program is attractive. 



2. Program provides opportunity for practice. 

_ 3. Practice is sufficiciit to help ensure mastery. 

_ 4. Examples are provided. 

_ 5; Examples are clear. * . 

_ 6. Presentation is logically sequenced. 

_ 7. Student has control over rate of presentation. 

_ 8. Feedback for incorrect responses is helpful for discovering cori i^ct answers. 

_ 9. Program allows learner to review, repeat, or advance according tc performance. 

_ 10. Program reports student performance periodically. 



1 1. Progn'im provides an appropriate balance between contenr 'presentation and student 

interactions or responses. 

12. Program offers a variety of interactions, varying k{fys pressed or responses required. 

^ 13. Program stimulates cognitive growth (or a new way of thinking). 

14. Program complements (or enhances) other Language Arts materials. 

^ 15. Program allows meaningful application of Language Arts J kills. 

IV. EASE OF OPERATION 

1. Directions to student are clear. 

2. Directions are accessible when needed. 

: 3. Student'can operate program independently. 

4. Student is prevented from getting lost in the program, v/ith no way out. 

5. Student is provided with option to quit or continue at any time. 

V. SUPPLEMENTARY MATERIAL 
_____ 1 . Program provides teacher's guide. 

2. Program provides supplementary student materials. 

3. If yes, materials are appropriate and useful. 



/ 
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: . 4. Program provides pre- and post-tests. 

5. Replacement print materials are available from producer. 

OVERALL EVALUATir>M 

Use the scale at the righ^ rate this program. (1 is lowest) 

!. MANAGEMENT FEATURES 

II. cor; TENT 

III. INSTRUCTIONAL STRATEGY , 

IV. EASE OF OPERATION 

y. SUPPLEMENTARY MATERIALS 

COMMENTS: Vv^hat are the program's strengths and weaknesses? 



1 2 3'' 4 5 
12 3 4 5 
12 3 4 5 



STUDENTS?" RESPONSES TO PROGRAM: 



RECOMME N DAT IONS : 



GUIDELINES ADDENDUM 

Choose the description which best fits the software you are reviewing, and repond to each criterion under 
that heading with a yes or no. ' 

A. SIMULATION/PROBLEM SOLVING (Learning through discovery and decision-making) 
' - 1. Problem-solving situation is realistic. ' \ 

2. Design is motivating. " 

-.-^ 3. Procedural tasks are clearly sequenced. 



4. Feedback to decisions is helpful^' ' 

'^S, Suggestions are given for optimum performance. 

6. Outcomes to choices are expUined. 

■ 7. The program is relevant to the acquisition of Language Arts skills.' 

B. EDUCATIONAL GAME 
1 . Format is motivating. 

2. Graphics are appropriate to presentation. 

3. Content is appropriate to Language Arts skills. 

4. Learner has access to help or review. 

5. There Ts an appropriate reward for success and no. "reward" for incorrect responses. 

6. Additional information or clues are provided by error feedback. 

C. TEACHER UTILITY (A program which allows teacher to "author" the content within a programmed 
format) • ^ . 

1. Directions to teacher are clear. ; 

- 2. Items are easy to enter- 

3. Editing is possible. ' / ^ 

4. Format for presenting items to student is appropriate. / c 

5. Student directions are clear. ^> 

• 6. The type of interaction is appropriate to the skills taught. 

7. Record-keeping is provided. ^ 

D. WORD PROCESSING/TE^CT EDITING (A^program which assists students in the composing proc- 
ess) 

1. Instructions are clear. 

2. Examples are provided^ ~' ^' 

3. Practice is provided. 

4- Editing and revising are possible. / - ■ . 

5. Editing capabilities are sufficient to writer's needs. / 

6. Editingjs easy to perform. / . 

7. Keys used for editing process are straightforward and easy to understand and manipulate. 



8. Stored data (spelling dictionary, etc.) are appropriate to learner's level. 

: •• . . i - 

9, Teacher can add to stored data. 

10. Learner has access to help or review. . 

11. There is provision for printing out compositions. 

12. The program makes a contribution to the composing process. 

E. OTHER TYPES OF SOFTWARE 

If the software you are reviewing does not fall into any of the above categories, you may wish to give a 
brief description of it below, followed by your evaluative comments. 
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provide students with strategies .for organiz- 
ing, responding to, or crystallizing textual in- 
formation, rather than merely serving as a 
vehicle for displaying that infomation? 

\ software used for language instruction: 

help students recognize language as a powerful 
tool for thinking and learning? 

illustrate the ways in which grammar repre- 
sents the orderliness of language and makes 
meaningful communication possible? 

demonstrate how topic, purpose and audience 
influence the structurenJnd use of language? 

help students learn how the English language 
has developed, continues to change, and sur- 
vives because it is adaptable to nesy times? 

provide opportunities for using language be- 
yond the letter, word ^d sentence levels? 

23 



help students recognize that precision in puncr 
tuation, capitalization, spelling and other 

, manuscript conventions is a part of the total 

' effectiveness of writing? 

Does software used for reading instruction: I 

help students learn to approach reading as a 
search for meaning? 

help develop the necessary reading skills to 
comprehend connected text in a variety of 
forms? 

demonstrate that reading functions are a plea- 
surable activity as well as a means of acquiring 
knowledge? ' 

help students to read accurately and make 
valid inferences? 

elicit personal and/or critical responses to lit- 
erature? 

I 

i" 
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\ 

Docs software designed to promote thinkini? skills: 

help students analyze, classify, compare, for- 
mulate hypotheses, make inferences and draw 
conclusions? \ • 

promote creative thinking by providing oppor- 
tunities to bring fresh perceptions to familiar 
ideas? ^ ' 

encourage logical thinking by providing op- 
portunities for constructing arguments, de- 
tecting fallacies in reasoning, and testing the 
validity of an assertion by examining the evi- 
dence? 

foster critical thinking by requiring students to 
ask questions, discriminate between fact and 
opinion, and evaluate the intentions and mes- 
sages of speakers and writers? 

Evaluating software tools such as word processing 
programs requires the use of more specific evalua- 
tion criteria that combine those" used for general 
purpose compute;' software reviews and criteria 
that reflect the adaptations that will be required to 
Use the software tools in the classroom. An example 
of a software tool that is transformed into a educa- 
tioal software package is Word Processing on the 
Apple, which teaches stucj^nts the fundamentals of 
word processing through the use of the Apple 
'Writer I program. The package was developed by 
the Minnesota Educational Computing Consor- 
tium, and includes specially prepared teacher and 
student support materials to accompany the com- 
mercial software program. An evaluation of the 
software alone is insufficient to assess its utility for 
classroom use. Onlyt^y evaluating the support ma- 
terials as well can a judgment be made on the qual- 
ity of the tool as an educational software package. 

An example of arj empirical evaluation of a soft- 
ware tool is that conducted by Virginia Bradley on 
three different word processing programs.' While 
the article describing the evaluation does not indi- 
cate whether Bradley conducted a review according 




/ 

/ 

/ 
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to criteria such as those in the NCTE checklist, her 
assessment incorporates criteria related to the abil- 
itv of the tools to accommodate the capabilities and 
limitations of her students. Bradley -suggests the 
following characteristics as important in using a 
' word processing program in the elementary grades: 

1. A screen editor is vital so that children can see 
their entire work (or a good portion of it) at one 
time. 

2. The screen should display upper and lower case 
letters. 

3. The text should be displayed'in a double-spaced 
format. 

4. Both large, primary type letters and norrpal 
sized ones should be'displayable by giving a 
command. 

5. Left and right arrow deletion and retrieval func- , 
tions are well accepted by children. 

6. Mnemonic commands that relate to children's 
vocabularies would be easier ?or them to learn 
and remember. 

7. A dictionary that checks for spelling and other 
structural errors would be an extremely useful 
component. 

8. The smallest numbef of commands possible 
should be used. 

9. A quiet printer is very important to avoid dis- 
turbing others in the classroom. 

Bradley's assessment illustrates the limitations of 
generic checklists in evaluating the utility of an ed- 
ucational software pirogram or software tool to be 
used in a particular subject area. Her additional 
criteria range from substantive curriculum stand- 
ards to relatively mundane concerns, such as that 
for a quiet printer. The best software evaluations 
will incorporate technical questions, as well as 
questions about the curriculum and its implemen- 
tation in thei:lassroom. 



'Virginia Bradley, "Improving Students' Writing 
with Microcomputers," Language Arts, October, 
1982, pp: 732-43. 
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SOFTWARE APl»LICATIONS: 
PRINCIPLES AND PRACTICES 

■ J 



Selecting high quality software and general purpose 
software tools is only part of the work of using soft- 
ware meaningfully in the classroom. Careful atten- 
tion must be given to how the software supports 
and advances the curriculum and instructional ob- 
jectives. The journal literature^ and descriptions of 
promising practices indicate that meaningful soft- 
ware use by teachers of reading and communica- 
tion skills is increasing substantially, even though it 
is a new activity for thervast majority of teachers. 
This section briefly reviews some educational pria- 
ciples and practices related to integrating software 
with the teaching of English, reading and writing. 

The first question to ask is what uses of the com- 
puter students should make, and for what pur- 
poses. In teaching read^pg and communication 
skills, the most typical modes of use (see "Evaluat- 
ing the Evaluation Schemes" in Part II) are likely to 
be as a tutor and as a tool. T-he literature contains 
. numerous examples of both application modes. If, 
as many experts indicate, computer literacy will be 
defined increasingly iil terms" 6f an individual's 
ability to use the computer to perform discipline- 
related tasks, teachers of reading and communica- 
tion skills will need to take a leadership role in 
designings and implementing instructional pro- 
grams that teach students how to^communicate us- 
ing the computer. ^' 

It is this emphasis on the tool mode that h^s moti- 
vated many teachers to incorporate text editing 
(word prok^essing) into their teaching of creative 
and expository writing. A few word processing pro- 
grams for ur>e by elementaiy grade students have 



been developed, and teachers are devising ways to 
teach stuj^ieiits to increase the quantity and the 
quality of their writing using the computer. At the 
secondary level, teachers are able to use generial 
purpose word processing programs that require 
greater ^^kill. As Kurland* points put, using the 
computef\as a tutor is not revolutionary, since it 
usually does what the teacher is ableto do. But Uses 
of the computer for writing, developing bibliogra? 
phies and research file databases, and*coairnuni- 
cating throug^i electronic, mail represent , 
step-function differences in the way important 
comn^unication skills can be taught. It is this kind 
of literacy that students will require in order to 
compete in t1ie job market, as well as in po5t-sec- 
ondary educiltion. 

Given this need^o help students acquire computer 
literacy for communication, the. selection of soft- 
ware involves making judgments on the appropri- 
ateness of general purpose tools already used in 
work environments. Application decisions will 
need to deal 'with the logistics of using a limited 
number of computers to accommodate skills devel- 
opment that require^ frequent and regular use by all 
students. The decision to use a so(tware program 
will require thorough use of the/checklists pro- 
vided, as well as detailed planning in classroom or- 



^D. Midian Kurland, "Educational Software Tools: 
The Rationale Behind the /Development of the 
Bank Street Writer." In Teaching Writing Through 
Technology: A Resource Guide, pp. 1 12-23, 



ganization and management. A review of software 
for use in th(? tutor and tool modes will serve to il- 
lustrate some' of the problems in selecting and using 
appropriate materials. 

Software as Tutor 

Tht^re is a considerable amount of software avail- 
able in this category. While much of it is criticized 
as being very limited technically an4 pedagogically, 
its usefulness is dependent on how and with whom 
it is used. Most of the software*is drill and practice 
in mechanics — word recognition, grammar — re-., 
quiring that the teacher use it within a comprehen- 
sive instructiofial plan. As Roblyer states, the key is 
"matching what software there is to identified 
needs in language instruction, and using all of this 
as the basis of a complete, vvell-designed pro- 
gram."' 

X)f course, there is better tutor software available, 
and new development is benefiting from the identi- 
fication of inadequacies in existing materials. One 
such development is the Writing to Read program 
currently being tested by John Henry Martin with 
- support from IBM. ^ The program teaches' young 
children to write and, in doing so, helps them to 
read. Writing to Read illustrates the way in which 
high <|uality computer-assisted instructional mate- 
rial is developed: The content and instructional 
methods are designed and testedf then the com- 
puter is used to support the materials, using all of 
its unique capabilities. This includes using true in- 
teraction, in which the coniputer adjusts its re- 
sponses to the student's . 

SAT courses aret^nother application of tutorial 
software. Responding to the rej>argence of interest 
in SAT scores (and to research which finds that 
"teaching" the SAT produces performance gains), 
educators are offering special tutorial classes. Be- 
cause of the SAT emphasis on Verbal skills, English 
teachers usually take a coordinating role in prepar- 
ing and conducting classes. Publishers are bringing 
several new programs to market for use in formal 
classes or in self-study applications. Evaluating 
and selecting a program involves using specific cri- 
teria related to these various applications. In'^addi- 
tion to applying general descriptive, application 
and evaluative criteria, the following questions 
need to be addressed: 

• Does the software include teacher and/or student 
management? If so, how many students will it 
accommodate? 

• Are there accompanying or reference materials? 

• Is the program regularly updated to incorporate 
changes in the SAT? 



• How much instruction does the program offer? 
(the quantity of instruction ranges from brief 
hints to lengthy tutorials) \ 

• ^hat is the turnaround time for backup disks? 

• Does the program include a timed practice test? 

• Is the practice test or any otl^er portion of the 
program scored? If yes, how? 

/ • Does the program hdve graphics and sound?' 

Software as Tool 

The most common application of software tools is 
the teaching of writing using word processing soft- \ 
ware. It is likely that future classes in cojnmunica- \ 
tion skills will include the use of electronic n\ail 1 
systems, online computerized databases (e.g., 
newspaper files or encyclopedias), and electronic 
filing systems which allow students to create blbli-. i 
ographies and research files on. the computer. At / 
present, however, these uses are unconimoh, and / 
word processing tools are receiving most of the at-/ 
tention of teachers of corfimunication skills. / ' 

Of th&Jsfcores oC word processors on the marke/, 
only a few are appropriate_for use in educVtj^n 
without considerable modification, particularly 
for upper elementary level, students. Two ejduca- 
tion-specific programs are cited he^e: The' Bank 
Street Writer and QUILL. / , - 

The' Bank Street Writer (available from Broder- 
bund Software,. 1 938 Fourth Street, San Rafael, CA 
94901 and Scholastic, Inc., 902 Sylvan Avenue, 
Englewood Cliffs, NJ 07632) was developed by In- 
tentional Educations, Inc. and Bank Street College* 
of Education. It is for the beginning writer, incor- 
porating tested instructional methods with techni- 
cally simple software. The program is^ designed to 
support the teaching of writing. For example, the 
student is encouraged to communicate without 
. worrying about mechanics (i.e., spelling, punctua- 
tion, paragraphing). In fact, the program discoflr- 
ages the student from editing and rewriting until 
s/he has completed the creative process. Only then 

*I^D. Roblyer, "Recommendations on Remedial 
Reading/Writing tabs," Educational Computer, 
May/June, 1983, p. 36<; 

' ^Leigh E. Zeitz, "Children Should Learn to Read by 
Learning to Write,*MfifoVyorid, May 23, 1983, 
pp: 17-21. 

^"To Succeed on the_SAT," Electronic Learning, 
April, 1983, p. 52. 



can s/he switch to the edit function and begin the 
more tedious process of rewriting. Such a technical 
design is consistent with correct teaching of the 
writing process. 

A more comprehensive set of writing software tools 
is QUILL, a program developed by Bolt, Beranek 
and Newman, Inc., of Cambridge, Massachusetts 
and The NETWORK, Inc, of Andover, Massachu- 
setts. The software is for students in grades 3-6, and 
has four components: 

The PLANNER enables the writer to organize 
tiipughts by posing a series of questions that 
when answered are a plan for creating a writ- 
ten piece. 

The WRITER'S ASSISTANT is a text editing 
system for children thai makes producing and 
revising what they have written easier. 

The LIBRARY is an information storage sys- 
tem that allows students to produce and share 
information about topics of study and inter- 
est. 

The MAILBAG is an electronic message sys- 
tem thafencourages students to .communicate 
via computer, as they will be doing in the near 
future. 

QUILL provides more than tools for processing 
words; it encourages cl"eative written communica- 
tion by providing motivations and opportunities 
for writing. QUILL is a modification of more so- 
phisticated software available in business and in- 
dustry; it helps students to become literate in the 
use of computer tools while learning basic writing 
skills. ^ , 

If QUILL repiesents the kind of computer skills 
that students will need to communicate ifi college, 

H 



work, and the home, then teachers of communica- 
tion skills will need to incorporate them into their 
curriculum. It is likely that more sophisticated mi- 
crocomputers and software will merge the tutorial 
and tutor modes. This would allow students, for ex- 
ample, to use word processing software to creale a 
report, and then use spelling and grammar checkers 
that not only identify errors, but provide students 
with appropriate instruction, while keeping records 
for the teacher on the lessons provided. 



Summary 

While the amount of available information dealing 
exclusively with reading and communication skills 
is small, general purpose criteria and procedures 
are applicable in most cases. Use of the criteria de- 
veloped by thcNew York State Education Depart- 
ment as a supplement to a rating instrument will 
help to customize the evaluation and selection pro- 
cess for reading and communication skills. 

The predominant uses of the computer in develop- 
ing reading and communication skills will be as a 
tutor and as a tool. The range and quality of tuto- 
rial software is increasing, but incorporating such 
software into the existing curriculum will continue 
to be the most difficult problem facing teachers. 

Perhaps the most potent and pervasive use of the 
computer will be as a text preparation and editing 
tool. Although research is scant and inconclusive, 
it appears that word processing tools can be used to 
promote creative communication and the develop- 
ment of the revision and editing skills essential to 
. good writing. 
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EFFECTIVENESS: WHAT 
THE RESEARCH SAYS 



There is a considerable amount of research avail- 
able on the^ effectiveness of computer-based in- 
struction, most of it pn the use of the computer as a 
tutor. For both the drill and practice and tutorial 
modes, the research concludes that computer- 
based instruction raises student achievement from 
the fiftieth percentile to about the sixty-fifth per- 
centile. This condusion was derived by reviewing 
scores of studies done at many sites over multi-year 
periods. 

Most of the research to date has been done at the 
secondary school level across all of the subject 
areas; but primarily in math and science. „Only a 
few studies have been conducted at the elementary 
school level, but findings from these tend to paral- 
lel those for the secondary level . One researcher, ex- 
amining studies conducte<i over several years, 
concluded that computer-based instruction was not 
as effective as peer or cross-age tutoring.* 

The time required to learn specific material is usu- 
ally considerably less for computer-based delivery. 
Costs are at least compjarable to those for tradi- 
tional instruction. 



'James Kulik "Synthesis of Research on Computer- 
Based Instruction," Educational Leadership, Sep- 
tember, 1983. p. 19. 



All of this research focused on the computer as a 
tutor. There is no conclusive research on the effec- 
tiveness of the computer used as a tool. For exam- 
ple, little is known on the impact of using a 
computer as a word processor to develop writing 
skills. This is understandable given the'recent use 
of word processing in schools. It probably will be ^ 
several years before there are definitive studies in 
this area. . 

For those wishing to review the research on com- 
puter-based instruction, the following references 
will serve as an introduction. 

Bracey, G.W. "Computers in Education: WJ^^S- 
the Research Shows." Electronic Learning. 
November/December, 1982, 51-54. 

Kearsley, G,; Hunter, B. and Seidel, R.J, "TWo 
Decades of Computer-Based Instruction Pro- 
jects: What Have We Learned?" THE Jour- 
nal, January, 1983, 90-94. February, 1983, 
88-96, ; 

Kulik* jIa. "Synthesis of Research on Com- 
puter-Based Instruction," Educational Lead-^ 
ership. September, 1983, 19-21 . 
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